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ABSTRACT 

The evaluation of professional support personnel in 
the schools has been a neglected area in educational evaluation. The 
Center for Research on Educational Accountability and Teacher 
Evaluation (CREATE) has worked to develop a conceptually sound 
evaluation model and then to translate the model into practical 
evaluation procedures that facilitate implementation by practitioners 
in educational settings. The Professional Support Personnel (PSP) 
model establishes a systematic evaluation method that builds on the 
commonalities of the various educational specialty areas while 
recognizing the distinctiveness of each. Handbooks are being 
developed to focus on the evaluation of counselors; library media 
specialists, school nurses, and school psychologists. Steps in the 
PSP model are: (1) identify system needs; (2) identify duties; (3) 
select performance indicators; (4) set performance standards; (5) 
document j o pe r f ormance ; (6) eva luat e per f ormance ; and (7) improve 
and maintain professional service. (SLD) 



Reproductions supplied by EDRS are the best that can be made 
from the original document. 



U ^ DEPARTMENT OF ECXJCATION 

• f. f ' { .1., d'.. r^' (<rs4»a' A< i>^p(. ,fr<-t»ri 

M."'-' r»a'>U»*'> 



r 



PERMISSION TOREPRODUCL ^HlS 
MAltBlAL HAS BetN GRANTED BY 



'0 THt tCHjCATluNAi RtSOJHCtS 



SCOPE OF INTEREST NOTICE 

The ERIC Facility has assigned 
this document for procatiing 



In ouf judgment, this document 
♦s also of inicrest to the Clear 
inghouses noted to the rcght 
Indexmg should reflect their 
spec«dl pomts of view 



00 

Q 



How Do You Evaluate Everyone Who Isn't A Teacher? 
An Adaptable Evaluation Model for 
Professional Support Personnel 



National Evaluation Institute 
Gatlinburg, Tennessee 
Julv 1994 



James H. Stronge - College of William and Mary 
Virginia M. Helm - Western Illinois University 
Pamela D, Tucker - College of William and Mary 



BEST COPY AVAILABLE 



Paper presented at the 
CREATE National Evaluation Institute 
July 10^15, 1994 
Gatlinburg, Tennessee 



Center for Research on Educational Accountabilit>' 
and Teacher Evaluation (CREATE) 

The Evaluation Center 
Western Michigan Universit>' 
Kalamazoo, MI 49008 



The Institute was supported in part by the Office of Educational Research and Improvement, U.S. 
Department of Education, (Grant No. R117Q00047). The opinions expressed are those of the 
authors, and no official support of these positions by die U.S. Department of Education is intended 
or should be inferred. 



PSP Evaluation Model 2 
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How Do ^ ou Evaluate Everyone Who Isn't A Teacher? 
An Adaptable Evaluation Model for 
Professional Support Personnel 

James H. Stronger Project Director - College of William and Mary 
Virginia M. Helm, Project Consultant - Western Illinois University 
Pamela D. Tucker, Research Assistant - College of William and Mary 

Introduction 

One of the most neglected areas of educational evaluanon has been that of 
professional suppon personnel - the non-teachmg» non-administrative professionals who 
serve as school counselors, media specialists, nurses, curriculum coordinators, etc. The 
educational accountabilii\ and reform movements of the last decade have focused heavily 
on classroom instructional effectiveness and teacher pertbrmance, with little attention paid 
K) professional suppon personnel. During the same time period, however, schools have 
become more complex organizations with a greater number of specialists who are in 
supportive roles - roles which frequently have not been evaluated in a formaK systematic 
manner. 

As local sch(K)l districts continue to develop disirict-wide evaluation plans, 
voluntarily or in response to the alH)\e- mentioned state mandates, educators face the 
challenge of designing and implementing proper evaluation criteria and procedures. The 
purpose of CREATE Project 2.2 and the Professional Suppon Personnel (PSP) Evaluation 
Model is to address this need by developmg a conceptually sound evaluation model and 
translating the model into practical evaluation prcx:edures which facilitate implementation by 
practitioners in educational settings. 
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DeTnonstrated Need 

Based on a national survey conducted in 1988 (Stronge, 1988), 42 states indicated 
they had a legal mandate to evaluate various suppon personnel professionals. However, 
only 17 states provided specific training to local districts for evaluating this diverse 
population. Among those states that provided guidelines and training, substantial 
differences existed regardinii the quantity and quality of assistance provided. Many school 
counselors, for example, had been evaluated using teacher evaluation forms containing 
cntena or procedures regarded as inappropnate or inapplicable to counselors. A full 
replication of the national survey was conducted in 1993 with similar results. As indicated 
by these studies and numerous other sources, valid, constructive, practical, and systematic 
evaluation policies and practices on a large-scale basis for professional suppon personnel 
are rare. It is to address this type of omission in the practice of educational personnel 
evaluation that Project 2.2 is dedicated. 

Professional support personnel (PSP) - counselors, library media specialists, 
curriculum specialists, special education resource teachers, school psychologists, school 
nurses, social workers, gifted and talented resource specialists, and athletic directors - are 
substantially represented in most elementary and secondary schools, as well as other 
educational settings throughout the United States. As school districts and other educational 
organizations develop personnel evaluation plans, either voluntarily or in response to local 
or state mandates, policy makers and educators face the challenge of designing and 
implementing evaluation criteria and pr(x:edures for all professional personnel, including 
those whose pnmar>' responsibilities do not involve classroom teaching or school 
administration. If an educational organization is to design a total personnel evaluation 
system that is oriented toward organizational effectiveness, methodologies appropriate for 
all personnel must be developed and appropriately implemented. 
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Intended Outcomes 

The Professional Support Personnel evaluation model that will serve as the focus 
for this project presents an integration of evaluation theor\' in a system designed explicitly 
with educational specialists in mind. The PSP evaluation model offers a practical and 
productive approach to designing workable personnel evaluation systems, not only for 
support personnel but also for teachers and administrators as researchers and practitioners 
work toward the development of a common evaluation model for use in educational 
settings. 

While the PSP evaluation mcKlel is a generalized one in that it is intended for a wide 
array of educational speciali.sts. the model is designed specifically for non-teaching and 
non-administrative professional personnel. By establishing a systematic evaluation system 
that builds on the commonalties of the v:irious educational specialty areas while recognizing 
the distinctiveness of each, a sensible and sound evaluation system can be designed. In 
addition to developing a systematic evaluation methcxiology that is common to each of the 
professional support personnel for which this project is targeted. Project 2.2 also will 
develop lists of job responsibilities and perronnance indicators that are specific to each of 
the personnel positions. This combination of common evaluation metnodology and 
customized evaluation substance makes the PSP evaluation model both practical for u.se by 
e valuators (i.e.. school principals) and appropriate for the specific evaluatee. 

Intended outcomes for the Project 2.2 include the funher refinement of a model of 
evaluation for professional support personnel which is field tested and disseminated in 
practical, practitioner-friendly products, Handb(X)ks are in the process of being developed 
which focus on the evaluation of selected professional positions: 

counselors 1994 

librar\' media specialists 1994 

school nurses 1995 

school psychologists 199? 
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They will reflect the liteniture and practicei* of the respective professional domains and v.'ill 
include the following: 

• comprehensive bibliographies; 

• annotated bibliographies on selected materials; 

• updated PSP Model; and 

• databases of job responsibilities and sample evidence. 
Intended Audience 

Project 2.2 is designed to assist professional support personnel and those who 
evaluate them in developing a meaningfully and useful evaluation pr(x:ess. Professional 
suppon personnel include three identified subgroups of non-teaching, non-administrative 
professional personnel: 

1. Pupil services personnel - e.g.. counselors, school psychologists, social 

workers, school nurses 

2. InstRictional support service personnel - e.g., deans, work-study coordinators, 

librarians, media specialists, special education related services personnel 

3. Academic/curriculum development service personnel - e.g., project directors, 

curriculum coordinators, content specialists, consultants 

4. Special education personnel - e.g.. self-contained classroom teachers, 

consulting resource teachers, speech therapists, occupational therapists, 
physical therapists 

In addition to the PSP. the project will provide services to state educarion agencies 
and local administrator-evaluators who have the responsibility of evaluating professional 
suppon personnel. Ultimately, the project is intended for the most important stakeholders 
in the educational enterprise - the students. 
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Professional Support Personnel Evaluation Model 
Description 

A meaningful and productive personnel evaluation system should address the 
unique contributions of each employee to the achievement of the school's mission. The 
Professional Support Personnel (PSP) Evaluation Model offers a practical, research-based 
model of personnel evaluation developed specifically to address the unique role demands of 
suppon personnel as defined by their professional training and the context in which they 
work. Integral to the model are the following three features. 

Individual/Institutional Balance . The PSP Evaluation Model is a systematic 
process thai directly relates organizational and individual goals in the evaluation cycle. The 
organizational need for accountability is served by beginning the evaluation process with an 
examination of system level needs (step 1 ) and relating prograrr. expectations to job 
responsibilities (step 2). Wnh program needs as a foundation for the evaluation prcx:ess, 
performance evaluation (step 6) not only reflects on the individual's performance but also 
on the organization's ability to achieve its goals based on the individual's contribution. 
Moreover, the professional de\elopmeni of the individual is enhanced by the collaborative 
delineation of job expectations, standards of performance, and valid methods of 
dcKHjmenling perfonnance. l^herefore. the model offers a persistent focus on opportunities 
for personal impro\ emeni ihroughoui the c\aluauon cycle. 

Emphasis on Communication . The PSP Mod'.l is predicated on the 
assumption that communication is central to effective evaluation. Since the ultimate goal of 
any evaluation is to continue successt'ul programs or improve less successful ones, 
feedback and open discussion are essential to a prcxiuctive evaluation process. Good 
communication between the e\ aluator and the person evaluated: 

• Allows for the cooperative development of an evaluation plan; 

• Provides a systematic opponunity for individual skill enhancement and 
improved perfomiance: 
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• Prov ides the eviiluaiee u iih ennanced self-expeciations; 

• Increases the likelihocxi of changes in behavior; 

• Identifies ways lo reach higher standards and correct significant discrepancies; and 
Establishes a check and balance system for the evaluation process. 

Multi-faceted Data Collection , In addition, to the imponance placed on 
communication and the relationship between an individual's performance and the system's 
needs, the PSP Model emphasizes multifaceted assessment techniques for documentation 
of job perfonnance. Multiple sources of information increase the validity of an evaluation 
for any professional, but are essential for the evaluation of suppon personnel. The "work" 
of a nurse, media specialist, or counselor is often best judged by means other than direct 
obser\'ation. Issues of confidentiality actually preclude observation in some cases, thus, 
requiring a creative u.se ol surve\ data, perfonnance artifacts, case notes, etc, to provide 
an accurate measure of job performance. 
Steps in the PSP Model 

The PSP Model reflects an exaluaiion cycle consisting of seven distinct steps which 
are brietly described below. Because the PSP Vlodel is improvement-oriented, steps four 
through ,seven should be repealed on a continual basis to promote opponunities for 
individual pcrfomiancc improvement. 

Step 1: Identify System Needs. Each educational organization has specific needs 
that :ire related to the organization's mission and that Lire met through the collective 
performance of all personnel, including suppoa persoimel. A systematic examination 
of the needs of the organization's constituents will help clarify its mission and purpose. 
Determining the needs of the organization is a prerequisite for all remaining steps if the 
evaluation process is to be relevant to the organization's mission and, ultimately, 
accountable to the public. 

Step 2: Identif\ Duties. Accurate and appropriiiie descriptions of job 
responsibilities or duties can be developed only from clear statements of organizational 
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goals and philosophic>.. Once organizational goals are deierminecl, then ii is only 
sensible to relate program expectations to position expectations (i.e., duties of the 
educator). See Chan 3 for a listing of eight general categories of responsibilities for 
professional suppon personnel. 

Step 3: Select Performance Indicators. Because job performance must be 
reflected in beha\ ior in order lo be evaluaied, this step invohes the identification and 
selection of behaviors or indicators (i.e., performance indicators) that are reflective of 
key job responsibilities (Step 2). While job responsibilities are intended to capture the 
essence of the job. it is difficult, if not impossible, to document the fulfillment of job 
responsibilities uiihoui some measurable indication of their accomplishment. Thus, to 
give meaning to these broader job responsibilities, it becomes necessar\' to select a 
sampling of perfomiance indicators that are both measurable and indicative of the job. 
Step 4: Set Performance Standards. Setting standards involves determining a 
level of acceptable pen'oimance. Because of program needs, available resources, the 
purpose of a specific position, and a variety of other factors, standards of performance 
ma\ \ar\' from organization to organization. The PSP evaluation system offers a 
method for setting standards rather than attempting to prescribe specific standards of 
performance \\h\ch do not reflect contextual variables. 

Step 5: Document job Performance. Documentation is the process of recording 
sufficient mfoniiation about the individual s performance to suppon ongoing evaluation 
of the staff member and to iustif\- an\ personnel decisions based on the evaluation. 
Documentation prc^edures rel\- on nniltifaceied data collection techniques including 
observation, questioning, and analysis of artifacts of performance. 
Step 6: Evaluate Performance. Evaluation is the proo/ss of comparing an 
individual's documented lob pcrtomiancc ^Mih the previously established performance 
standards. Depending on the timing of this comparison, this discrepancy analysis can 
serve either formative or summative purposes. The conference itself is an occasion for 

1 U 
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candid communivjation between e\ aluator and evaluatee. Identificaiion of discrepancies 
between standards and perfonnance, and discussions of reasons for those discrepancies 
is the primar> but not the sole focus of the conversation. Emphasis on areas for 
improvement or on new objectives should be incorporated into the evaluation process. 
Step 7: Improve and Maintain Professional Service. With an emphasis in 
the evaluation prcx^ess on both improvement (i.e., formative) and accountability li.e., 
summative) purposes, this step brings the process full circle. Formative aspects of 
evaluation, intended to provide recognition for notewonhy performance, along with 
immediate and intermediate feedback for performance improvement and correction 
where needed, should be ongomg throughout the evaluation process and are implicit in 
this model. Nonetheless, it is beneficial to provide an explicit step for improving or 
maintaining performance :is the culmination of the evaluation cycle and as an entree into 
the following cycle. This .step suggests the imponance of ongoing professional 
development with a balance between the interests of individuals and the interests of 
institutions in a continuous miprovement cycle. After all. the most fundamental 
purpo.se of the evaluation is to improve both the individual s and institution's 
performance. 
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